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LONG-TERM  GOALS 

The  optical  impacts  of  a  scattering  benthic  boundary  layer  are  fairly  obvious  to  in  situ  and 
remote  sensing  techniques  that  measure  ocean  color.  These  scattering  layers  cause  an  increase  in  light 
reflectance  from  positions  above  the  benthos,  a  reduction  in  the  penetrating  photons  to  the  bottom,  and 
a  decrease  in  photons  scattered  from  the  bottom  back  toward  the  surface.  The  net  result  is  that  these 
layers  reduce  the  ability  of  active  and  passive  optical  instruments  to  retrieve  estimates  of  bathymetry 
and  bottom  classification,  as  well  as  reduce  the  abilities  of  optical  Mine  Counter  Measures  (MCM) 
instrumentation  to  accurately  image  the  bottom  for  mine-like  objects.  These  scattering  layers  are  not 
just  optically  active,  they  are  in  fact  acoustically  scattering  as  well.  These  scattering  layers  may 
introduce  some  real  difficulties  into  both  the  optical  and  acoustical  methods  of  detecting  mine-like 
objects,  reducing  the  viability  of  two  major  techniques  in  MCM.  The  project  seeks  to  assess  the  spatial 
extent  of  these  nepheloid  scattering  layers  with  active  and  passive  remote  sensing  techniques,  and 
quantitatively  resolve  their  vertical  structure. 

OBJECTIVES 

1)  To  assemble  simultaneously  collected  high  resolution  active  (LIDAR)  and  passive  (Spectral 
Imaging)  optical  remote  sensing  data  in  areas  that  are  impacted  by  nepheloid  scattering  layers. 

2)  To  develop  the  quantitative  techniques  to  resolve  the  vertical  structure  of  Inherent  Optical  Properties 
(IOPs)  in  the  water  column  from  optical  remote  sensing  data. 

3)  To  fuse  the  active  and  passive  remote  sensing  data  streams  to  produce  digital  information  products 
of  bathymetry,  bottom  type,  and  vertically-structured  IOPs. 


APPROACH 


The  use  of  spectral  imagery  for  classification  of  benthic  properties  into  information  products  such  as 
bathymetry  and  bottom  type  has  a  long  history  in  the  open  literature  history  (Ackleson,  1997;  Dierssen 
et  al.,  2003;  Lee  et  al.,  1998;  Lee  et  al.,  1999;  Lee  and  Carder,  2002;  Louchard  et  al.,  2003;  Lyzenga, 
1978;  Maritorena  et  al.,  1994;  Mobley  et  al.,  2004;  O'Neill  and  Miller,  1989;  Philpot  et  al.,  2004; 
Philpot  and  Kohler,  1999;  Philpot,  1989;  Sandidge  and  Holyer,  1998;  Stumpf  et  al.,  2002).  The  desire 
to  use  spectral  imagery  instead  of  more  traditional  means  of  estimating  this  type  of  information  via  the 
use  of  in-water  systems,  e.g.  bathymetric  sounders,  multi-beam  sonar,  and  side-scan  sonar,  stem  from 
the  differences  in  deployment  characteristics  of  the  remote  sensing  and  in-water  platforms.  These 
differences  may  be  seen  in  Figure  1,  where  it  is  evident  that  the  swath  width  of  the  in-water  systems 
decreases  substantially  as  the  height  of  the  sensor  above  the  bottom  decreases.  This  means  that  the 
effective  data  or  information  acquisition  rate  decreases  significantly.  In  shallow  waters  less  then  5-10 
m,  these  systems  may  be  costly,  as  the  drafts  of  the  survey  ships  are  too  deep  to  operate  safely 
requiring  the  use  and  coordination  of  a  fleet  of  small  craft.  This  may  just  be  too  cost  prohibitive  to 
collect  the  data,  as  the  time  on  station  may  exceed  budgetary  constraint.  In  addition  to  budgetary 
constraints,  the  U.S.  Navy  has  operational  requirements  that  may  not  allow  for  surface  vessels  to  be 
exposed  in  the  near  shore  environment.  These  “access  denied”  areas  require  a  mechanism  to  remotely 
assess  the  bathymetry  and  bottom  type,  with  the  benefit  of  the  in  water  systems. 

These  budgetary  and  access  constraints  have  focused  a  tremendous  amount  of  interest  on  the 
capabilities  of  retrieving  marine  environmental  information  from  passive  spectral  remote  sensing. 

Early  efforts  focused  on  single  or  multi-wavelength  approaches  (Ackleson,  1997;  Lyzenga,  1978; 
Maritorena  et  al.,  1994;  Philpot,  1989)  that  use  a  form  of  the  two-flow  equation  (Mobley,  1994)  to 
estimate  the  bathymetry  based  upon  assumptions  about  the  water  clarity  and  bottom  reflectance 
characteristics.  The  regression  analysis  of  the  predicted  bathymetry  versus  true  bathymetry  of  these 
early  efforts  demonstrated  admirable  results.  Yet,  frequently  there  were  off-sets  in  the  estimates  that 
were  ascribed  to  environmental  errors,  including  errors  in  the  estimation  of  water  clarity  or  bottom 
types.  This  problem  was  (is)  more  specifically  related  to  the  need  to  know  the  Inherent  Optical 
Properties  (IOPs)  of  the  water  column,  which  includes  the  bottom  reflectance,  before  one  could  use  the 
two-flow  equation  in  remote  areas  with  little  field  data  or  validation. 

The  shallow  water  inversion  problem  in  its  most  general  form  is  the  radiative  transfer  equation.  The 
radiative  transfer  equation  describes  the  gain  and  loss  of  photons  along  a  given  path  through  the 
interaction  equations  that  govern  absorbance,  scatterance,  and  transmittance  (Mobley,  1994).  The 
application  of  the  radiative  transfer  equation  to  the  shallow  water  inversion  problem  requires  one  to 
simultaneously  solve  for  bathymetry,  bottom  reflectance,  and  vertically-structured  IOPs  when 
attempting  to  retrieve  an  optical  reflectance  signal  (Figure  2).  This,  of  course,  was  known  by  earlier 
investigators,  but  the  number  of  degrees  of  freedom  (i.e.  the  number  of  spectral  bands)  in  the 
reflectance  data  was  limited  in  these  previous  studies,  and  advancement  required  working  with  the 
available  data. 

HyperSpectral  Imaging  (HSI)  offers  the  potential  to  increase  the  number  of  degrees  of  freedom  by 
which  to  invert  the  radiative  transfer  equation  in  shallow  waters  (Lee  et  al.,  1998;  Lee  et  al.,  1999;  Lee 
and  Carder,  2002;  Louchard  et  al.,  2003;  Mobley  et  al.,  2004;  Mobley  et  al.,  2002;  Sandidge  and 
Holyer,  1998).  This  allows  for  multiple  approaches  to  resolving  the  simultaneous  variations  in 
bathymetry,  bottom  reflectance,  and  vertically-structured  IOP.  Two  of  the  more  common  approaches 
discussed  include  lookup  table  approaches  that  match  presolved  solutions  to  the  radiative  transfer 
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equation  to  the  HSI  and  neural  network  approaches  that  let  the  scene  or  some  limited  number  of 
presolved  solutions  train  the  retrieval  algorithm  (Philpot  et  al.,  2004).  Both  of  these  approaches  use 
computationally  intensive  processing,  which  employ  the  greater  degrees  of  freedom  offered  by  the  HSI 
data,  to  retrieve  a  more  robust  estimate  of  bathymetry. 

There  are  other  optical  remote  sensing  means  to  accomplish  bathymetric  soundings.  Specifically 
active  airborne  remote  sensing  in  the  form  of  Light  Detection  And  Ranging  (LIDAR)  has  some  of  the 
same  advantages  as  the  passive  HSI  (Guenther,  2001 ;  Guenther  et  al.,  2000;  Irish  et  al.),  e.g.  constant 
swath  over  changing  bathymetry,  as  well  as  some  others,  such  as  24/7  operations  and  International 
Hydrographic  Office  (IHO)  Level  1  qualification  for  bathymetry  sounding.  The  LIDAR  bathymetry 
soundings  are  less  sensitive  to  IOP  variations,  and  the  quality  of  the  data  (as  recognized  by  the  USACE 
and  IHO)  provides  bathymetry  estimates  sufficient  for  nautical  charting.  And  after  nearly  1 0 
years  of  development,  the  Naval  Oceanographic  Office  (NAVO)  took  delivery  of  the  Compact 
Hydrographic  Airborne  Rapid  Total  Survey  (CHARTS),  which  included  the  latest  version  of  the 
Scanning  Hydrographic  Operational  Airborne  LIDAR  Survey  (SHOALS).  This  system  provides 
operational  optical  sounding  from  an  airborne  remote  sensing  vehicle. 

The  availability  of  two  optical  techniques  to  retrieve  a  similar  environmental  attribute  offers  the 
potential  for  data  fusion  applications  that,  at  a  minimum,  can  identify  geographic  areas  of  high  error 
potential.  The  comparison  of  the  two  sounding  estimates  may  also  offer  system  performance 
evaluations  that  help  define  and  refine  total  data  quality.  Lastly,  the  true  fusion  of  the  active  and 
passive  data  stream  may  yield  higher  quality  estimates  of  the  vertically-structured  lOPs,  as  well  as 
bottom  type  retrievals.  This  would  provide  validation  and  calibration  resources  to  both  data  streams, 
which  in  turn  would  provide  the  highest  quality  environmental  digital  mapping  products  to  civilian  and 
military  users. 


Figure  1.  FERI/NRL/NA  VO/USACE  Joint  Hyperspectral/LIDAR  Experiment  October,  2002.  RGB 
image  of  the  HSI  data  with  SHOALS  coverage  colored  in  red  (left);  The  distribution  of  relative 
errors  between  LUT  retrieved  bathymetry  and  SHOALS  LIDAR  bathymetry  (right).  This  represents 
comparisons  of  >  1.9 x  106  co-located sounding.  A  Gaussian  curve  is  added  to  demonstrate  the 
effectiveness  of  the  LUT  approach.  The  distribution  or  errors  is  far  more  centered  around  zero  than 
would  be  expected  for  a  normally-distributed  population. 
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WORK  COMPLETED  -  Year  1 


In  October  of  2002,  a  joint  FERI/NRL/NAVO/USACE  HSI/LIDAR  experiment  was  conducted  off  of 
Looe  Key,  FL  (Figure  1).  This  experiment  yielded  high  quality  HSI  data  at  a  2  m  resolution  and 
bathymetric  LIDAR  data  at  a  4  m  resolution.  The  joint  data  set  allowed  for  the  advancement  and 
validation  of  a  previously  generated  Look-Up-Table  (LUT)  approach  to  the  simultaneous  retrieval  of 
bathymetry,  lOPs,  and  bottom  type  (see  Mobley,  N0001400D01 610001,  and  Bissett, 

N000 140 110201). 

During  the  field  experiment,  NRL-Stennis  and  NRL-DC  collected  in  situ  Rrs(A.),  as  well  as  spectral 
absorption  and  scattering  with  a  slow  drop  optical  package.  The  Rrs(X)  data  were  used  to  constrain  a 
tabularized  atmospheric  correction  model  (TAFKAA)  to  correct  the  HSI  data  sets.  TAFKAA,  which 
was  developed  by  the  Naval  Research  Laboratory  (NRL),  employs  a  look  up  table  based  correction 
scheme  based  on  a  modification  of  the  Ahmad  &  Fraser  (1982)  vector  radiative  transfer  code  that  was 
developed  by  the  Naval  Research  Laboratory  (NRL).  The  TAFKAA  code  and  tables  were  generated 
using  subroutines  from  a  previously  developed  atmospheric  correction  code  designed  for  hyperspectral 
data  (ATREM),  and  further  modified  by  NRL  (Gao  et  al.,  2000).  The  TAFKAA  tables  are  pre¬ 
calculated  for  a  variety  of  scattering  aerosols  and  atmospheres.  Guided  by  the  solar  and  sensor 
geometries  and  environmental  conditions,  it  returns  a  solution  that  it  applies  to  the  PHILLS2  data  set. 
The  sensor  and  solar  geometries  are  directly  derived  from  the  data’s  time  stamp  and  positional 
information.  The  environmental  conditions,  on  the  other  hand,  need  to  be  selected  by  the  user.  The 
parameters  that  TAFKAA  utilizes  are:  ozone  concentration,  aerosol  optical  thickness,  water  vapor, 
wind  speed,  aerosol  model,  and  relative  humidity. 


Figure  2.  Bottom  classification  into  four  types  (sand,  seagrass,  coral, and  hardbottom)  of  the  HSI 
data  set  (on  Left)  collected  in  2002  and  the  NOAA  NOS/  FMRI  data  set  (on  Right)  collected  in  1992. 
Missing  data  from  either  data  set  were  omitted  from  the  evaluation  (white  spaces). 

RESULTS  -  Year  1 

With  the  atmosphere  properly  removed,  the  HSI  image  can  now  be  used  for  advanced  algorithm 
development.  We  have  been  developing  a  radiatively  robust  method  that  employs  a  Look-Up-Table 
(LUT)  of  simulated  solutions  of  Rrs(X)  for  homogenous,  optically  clear  water  columns  in  tropical 
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environments.  This  approach  is  based  on  simulating  values  of  Rrs(^)  based  on  pre-selected  water 
column  inherent  optical  properties  (IOPs),  bottom  depth,  and  bottom  reflectance  (Mobley  et  al.,  2002; 
Mobley  and  Sundman,  2003).  This  approach  is  focused  on  comparing  the  calibrated  and 
atmospherically-corrected  Rrs(A,)  to  the  LUT’s  records  for  every  pixel  in  the  image.  For  each 
successful  match  of  a  LUT  record  to  the  spectra,  the  water  type,  bottom  type,  and  depth  associated 
with  the  LUT  record  was  then  associated  with  the  PHILLS  spectra’s  location.  It  is  important  to  note 
that  the  library  of  bottom  reflectance  spectra  used  in  this  exercise  was  obtained  from  Bahamian  waters 
and  not  from  the  image  collection  location.  In  addition,  the  IOPs  were  simulated,  not  measured, 
demonstrating  the  ability  of  this  technique  to  identify  and  characterize  Rrs  spectra  outside  of  the 
calibration/validation  region. 

The  use  of  SHOALS  data  allowed  us  to  develop  error  statistics  for  the  bathymetric  retrievals,  as  well 
as  delineate  areas  where  the  LUT  algorithm  performed  poorly,  seen  as  the  spike  in  the  distribution  of 
relative  errors  at  the  +50%  level  (Figure  1).  This  poor  performance  resulted  from  an  incomplete 
knowledge  of  the  bottom  characteristics.  In  addition,  further  study  of  the  error  statistics  led  to  the 
discovery  that  the  ball  bearings  on  the  SHOALS  scanning  mirror  were  significantly  degraded,  causing 
a  cross-track  error  in  the  SHOALS  data  of  approximately  50  cm.  Thus,  this  LUT  approach  at 
separating  bottom  depth  and  reflectance  from  in-water  IOPs,  particularly  if  the  library  of  bottom 
reflectance  spectra  were  obtained  locally,  may  be  even  better  than  the  data  suggests. 

The  LUT  solution  also  provided  estimates  of  bottom  type  and  IOPs.  These  bottom  type  estimates  were 
categorized  into  4  categories.  Sand,  Seagrass,  Coral,  and  Hardbottom,  and  were  matched  to  the  FDGC 
metadata  files  from  the  1992  NOAA/FWRI  photo-survey  of  the  Florida  Key  (National  Ocean 
Atmospheric  Administration  National  Ocean  Services  and  Florida  Marine  Research  Institute,  2000). 
Initial  results  suggested  that  there  appeared  to  be  good  overall  retrievals  for  the  LUT  Sea  Grass 
(Producer  Accuracy  >85%),  but  less  success  with  the  Coral,  Hardbottom,  and  Sand  estimates  (Figure 
2).  In  particular,  there  were  significant  areas  of  the  reef  face  that  were  identified  as  Sand  or 
Hardbottom,  and  not  as  Coral. 

The  fact  that  the  bathymetry  matched  fairly  well,  even  if  the  IOPs  and  bottom  type  were  not  perfect, 
resulted  from  the  LUT  selection  algorithm  being  optimized  for  bathymetric  retrievals.  This  result  is 
very  heartening  because  it  suggests  that  the  approach  to  HSI  bathymetry  need  not  have  a  perfect  IOP 
and  bottom  type  database  in  order  to  retrieve  significantly  robust  bathymetric  results.  While  this  is  a 
good  result  for  applications  in  access  denied  areas,  it  does  not  provide  the  required  accuracy  in  bottom 
typing  and  water  quality  for  civilian  resource  management. 

Fortunately,  this  was  just  the  first  test  of  this  approach,  and  the  LUT  database  contained  only  12,000 
entries,  owing  to  the  limited  vertical  resolution  and  IOP  entries.  The  increased  vertical  resolution  will 
help  reduce  bathymetric  errors.  This  will  be  combined  with  a  much  greater  distribution  of  IOPs  and 
will  generate  a  much  larger,  more  representative  database  for  this  environment  (currently  estimated  at 
>  2  million  entries).  Once  the  generation  of  this  new  database  is  complete,  this  analysis  will  be 
reconstructed.  It  is  anticipated  that  this  larger  database  will  yield  a  much  more  robust  HSI/LUT 
solution  for  bathymetry,  bottom  type,  and  IOPs,  as  well  as  even  better  fusion  of  the  LIDAR/HSI  data 
products.  Clearly,  these  results  show  the  value  of  coupled  data  streams  in  the  retrieval  of 
environmental  attributes.  The  fusion  of  active  LIDAR  and  passive  HSI  shows  promise  in  the 
development  of  new  techniques  to  produce  information  products  for  both  military  and  civilian 
applications. 
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WORK  COMPLETED  -  Year  2 


In  2004,  FERI  collected  hyperspectral  imagery  Humboldt  Bay,  CA,  which  is  significantly  more  turbid 
than  the  Florida  Keys  (Figure  3).  During  July  of  2004,  active  acoustic  bathymetry  from  multibeam  and 
single  beam  sonar  was  collected  over  the  Bay,  which  will  be  used  for  active/passive  fusion  studies  in 
FY  2006  (Figure  4). 


Figure  3.  FERI  HSI  of  Humboldt  Bay,  CA  collected  October  2  7,  2004.  Multibeam  and  singlebeam 
sonar  were  collected  within  the  entire  bay  during  July  2005. 

Results  from  related  projects  (Bissett,  N0001401 10201,  Mobley,  N0001404C0218  and 
N0001404M0108)  suggested  that  prior  expectations  of  increasing  the  size  of  our  LUT  database  (from 
12,000  separate  spectral  Rrs  entries  to  235,625  entries)  would  reduce  the  bathymetric  errors.  However, 
contrary  to  expectation,  the  bathymetric  errors  increased  with  the  increase  in  the  number  of  database 
entries.  This  was  driven  mainly  by  sensor  and  environmental  noise  in  the  imagery  data,  as  well  as 
database  entries  that  were  not  representative  of  the  bottom  type  and  water  quality  of  the  image 
location.  These  results  forced  us  to  revisit  the  spectrum  matching  selection  criteria,  with  emphasis  on 
using  a  threshold  and  other  spectral  weighting  techniques  to  reduce  the  bathymetric  error  rate  in  the 
Looe  Key  imagery. 
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Figure  4.  Combined  HSI  RGB  with  2002  topographic  LIDAR  bathymetry,  and  2005  multibeam 
bathymetry  and  single  beam  bathymetry  for  northern  Humboldt  Bay. 

RESULTS  -  Year  2 

In  the  current  LUT  spectral  matching,  each  wavelength  is  assigned  equal  importance.  RMS  error  is 
calculated  between  the  image  spectrum  and  LUT  spectrums,  and  the  spectrum  with  the  least  RMS 
difference  is  chosen  as  the  best  match.  An  inherent  problem  with  this  approach  is  that  in  hyperspectral 
remote  sensing  of  coastal  environment,  the  wavelengths  that  has  the  most  information  changes 
drastically  depending  on  the  environmental  factors  like  bathymetry  and  bottom  type.  When  comparing 
spectrums  for  very  shallow  waters,  the  wavelengths  that  contain  the  most  differentiable  information  are 
very  different  from  comparing  deep  water  spectrums.  For  example,  the  IR  wavelengths  generally  have 
no  information  in  waters  deeper  than  one  meter,  while  for  shallow  regions  with  green  bottom,  it  has  the 
most  information.  Thus,  most  of  the  signal  recorded  in  the  IR  region  for  deeper  waters  is  sensor  noise 
and  giving  equal  importance  to  IR  wavelengths  in  matching  can  result  in  high  susceptibility  to  noise. 
On  the  other  hand  excluding  the  IR  wavelengths  in  matching  can  result  in  lower  classification  accuracy 
in  shallower  depths.  A  mechanism  needs  to  be  developed  in  consideration  of  the  above  observations, 
which  can  help  determine  the  usefulness  of  a  particular  wavelength  in  spectrum  matching. 

The  approach  taken  was  to  try  simplistic  algorithms  first  and  keep  mutating  it  into  more  complex  ones 
according  to  the  observations  and  results.  The  first  method  tried  was  static  thresholding.  The 
wavelengths  to  be  used  in  the  matching  were  predetermined  and  it  remained  the  same  for  all  the  image 
spectrums.  The  spectrums  were  matched  only  on  the  wavelengths  selected  and  the  rest  of  the  spectrum 
was  ignored.  Initially  all  the  wavelengths  available  were  used  in  LUT  matching.  The  base-level  LUT 
has  wavelength  range  of  400nm-760  run,  and  was  taken  as  the  initial  threshold.  Figure  5  shows  the 
absolute  depth  difference  between  the  depth  derived  from  PHILLS  image  using  the  LUT  technique  and 
SHOALS  image.  As  seen  from  the  image,  the  classification  error  at  some  places  was  more  than  8 
meters.  This  was  considerably  worse  compared  to  the  classification  obtained  using  the  12K  LUT. 
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Figure  5.  Absolute  difference  in  depths  between  200K  LUT  using  static  thresholding.  (LEFT) 
Bathymetric  errors  between  LIDAR  and  HSI  LUT  estimates  using  full  HSI  spectrum  to  760  nm. 
(RIGHT)  Absolute  difference  in  depths  using  static  thresholding  at  660  nm;  note  the  decrease  in 
errors  in  the  deeper  regions  of  Hawk  Channel  with  the  reduce  spectral  resolution. 

As  any  wavelength  beyond  660  would  not  have  any  signal,  except  for  very  shallow  depths,  660  nm 
was  selected  as  the  second  threshold.  Thus  the  spectrum  was  matched  only  between  400-660  nm 
wavelengths  and  rest  of  the  spectrum  was  discarded.  The  right  Figure  5  shows  the  classification 
accuracy  by  this  method.  As  there  was  a  slight  improvement  in  the  classification  accuracy  by  selecting 
a  narrower  threshold  of  660  nm,  the  threshold  was  made  narrower  until  the  accuracy  started  to  reduce 
again.  It  was  noted  that  when  thresholding  was  done  at  575  nm,  the  classification  accuracy  was  the 
best  on  average  as  shown  in  Figure  6. 
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Figure  6.  Absolute  difference  in  depths  using  static  thresholding  at  575.  This  wavelength  threshold 
provided  the  best  overall  bathymetry  match  between  the  LIDAR  and  HSI LVT  using  a  static 

threshold. 

As  seen  in  Figure  6,  thresholding  at  575  nm  gives  good  classification  accuracy  in  deeper  depths  but  is 
significantly  worse  in  shallower  depths.  This  is  because  shallower  depths  have  a  lot  of  information  in 
the  575-700  nm  wavelength  range  that  is  ignored  in  the  thresholding.  Figure  7  is  a  plot  of  few 
spectrums  from  the  upper  left  comer  of  the  image  where  classification  accuracy  for  the  image  using 
575  thresholding  was  worse  then  the  660  thresholding  image.  The  figure  clearly  explains  why  the  575 
thresholding  performs  poorly  at  shallow  depths.  Shallow  water  spectrums  have  information  between 
575  and  660  nm  which  is  completely  excluded  by  thresholding,  and  thus  it  retrieves  substantially 
deeper  depths.  On  the  other  hand,  even  the  14.25  m  deep  image  spectrum  has  response  in  IR 
wavelengths.  This  is  a  result  of  the  sensor  and  environmental  noise.  Due  to  this  noise,  artificial  dark 
bottoms  were  retrieved,  which  forces  the  underestimation  of  the  depths  in  classification.  Figure  7 
shows  the  bottom  selected  by  both  methods.  The  results  confirm  the  hypothesis  that  the  usefulness  of 
any  wavelength  in  matching  two  spectrums  is  a  function  of  the  features  of  those  spectrums. 

It  may  be  impossible  to  find  a  wavelength  range  that  can  be  used  to  match  all  the  spectrums.  However, 
it  may  be  possible  to  use  the  fusion  of  active  data  to  more  clearly  select  the  appropriate  wavelength 
range  for  retrieval  of  bathymetry,  bottom  type,  and  water  column  IOPs.  This  will  allow  us  to  increase 
the  accuracy  of  our  retrievals,  while  reducing  the  impact  of  sensor  and  environmental  noise  on  the  HSI 
LUT  techniques.  This  will  be  the  focus  of  our  FY  2006  work,  with  both  the  Looe  Key  and  Humboldt 
Bay  data. 

Work  Completed  and  Results  -  Year  2  (Addendum,  this  Grant  ended  April  2006) 

In  order  to  best  complete  the  applied  and  theoretical  aspects  of  this  overall  effort  (PI  Bissett  - 
N000 1404 10297  and  PI  Mobley  N0001404M0108),  we  decided  to  divide  the  labor,  with  our  efforts 
focused  on  the  analysis  of  the  existing  data  and  the  development  of  the  numerical  code  to  rapidly 
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process  HSI  imagery.  Mobley’s  effort  was  to  study  the  theoretical  limits  of  resolving  vertical  structure 
in  inhomogeneous  waters. 


Figure  7.  Spectrums  plots  for  regions  where  static  thresholding  had  considerably  low  and  high 
classification  accuracy.  The  shallow  water  (brighter  grouping)  had  better  matches  using  larger 
thresholds  because  of  the  real  NIR  information  in  the  image  spectrum.  However,  the  NIR 
information  was  of  lower  quality  in  the  deeper  water,  causing  significant  errors  in  the  larger 

threshold  retrievals. 

In  the  continuation  of  the  application  of  the  current  approach  into  turbid  waters,  we  focused  on  the 
southern  portion  of  Humboldt  Bay  (Figure  3).  Our  initial  LUT  generated  bathymetric  retrieval  shows 
reasonable  success  at  estimating  the  bathymetry  in  the  bay.  These  bathymetry  estimates  were 
compared  against  topographic  LIDAR  data  that  were  collected  during  a  seasonal  tide  below  MLLW. 
Analysis  of  these  results  suggested  some  of  our  greatest  errors  may  result  from  differences  in  eel  grass 
canopy  heights  versus  bare  earth  bathymetry  (Figure  8),  since  the  eel  grass  canopy  may  rise  upward  to 
two  meters  above  the  bottom  (R.  Zimmerman,  ODU,  per.  comm.).  This  introduces  an  important 
consideration  when  fusing  multiple  remote  sensing  data  streams  collected  at  different  time  periods. 
Specifically,  how  do  we  deal  with  transient  signals?  In  this  case,  we  collected  the  HSI  data  during  the 
maximum  height  in  the  tide,  the  LIDAR  data  was  collected  at  the  other  tidal  extreme.  The  result  was 
that  our  indications  of  bottom  depth  were  skewed  by  the  top  of  the  eel  grass  canopy.  Any  active  or 
passive  sensor  operating  in  these  shallow  turbid  waters  would  be  faced  with  these  same  eel  grass 
problem.  How  one  addresses  these  issues  becomes  an  important  part  of  the  analytical  product  to  be 
delivered  to  the  user  community.  It  also  points  to  the  need  for  confidence  intervals  to  these  product 
estimates,  such  that  these  issues  and  uncertainties  are  illuminated  in  the  final  mapping  product. 
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Figure  8.  Topographic  LIDAR  bathymetry  estimates  (Left)  calculated  by  estimating  the  tidal  height 
above  the  MLLW for  which  this  data  was  collected.  The  channels  in  magenta  are  actually  deeper 
than  shown ,  but  the  topographic  LIDAR  system  was  not  able  to  penetrate  the  water.  Difference 
between  topographic  LIDAR  estimated  bathymetry  and  LUT  estimated  bathymetry  (Right).  Greatest 
difference  is  in  the  NW  corner  and  along  channel  edges.  These  regions  correspond  to  high 
concentrations  of  eel  grass,  which  may  extent  upwards  to  2  m  above  the  bottom. 

In  an  expansion  of  the  method  used  in  Figure  6  and  7,  we  began  experimenting  with  a  “dynamic 
threshold”  procedure  that  allowed  the  spectrum  itself  to  determine  the  threshold  that  best  suited  the 
reflectance  spectrum  (seen  also  in  N0001401 10201).  This  dynamic  threshold  approach  yielded  the 
results  found  in  Figure  9.  The  pattern  errors  still  existed,  mainly  centered  in  Hawk  Channel  (errors  as 
high  as  6  m),  however  the  relative  errors  were  held  below  40%  over  most  of  the  image.  This  dynamic 
threshold  procedure  appeared  to  be  the  best  we  could  do  with  the  PHILLS  data  set  and  the  single  value 
LUT  approach. 

At  this  point  we  decided  to  step  back  and  look  at  this  problem  from  another  angle.  One  of  the  goals  of 
this  effort  was  to  provide  not  only  the  ability  to  look  for  scattering  layers,  but  also  to  develop 
confidence  intervals  on  the  solutions  found  by  our  inversion  methods.  This  goal  required  a  different 
perspective,  where  uncertainty  is  specifically  addressed  in  the  inversion  solution.  We  have  begun 
developing  an  approach  that  moves  away  from  thresholding  per  se,  but  still  allows  the  data  to  impart 
intelligent  parameters  to  the  search  criteria.  The  ability  to  use  the  HSI  data  itself,  along  with  the 
hundreds  of  thousands  (millions)  of  potential  solutions  of  the  theoretical  Rrs,  provides  us  with  the 
ability  to  further  optimize  the  search,  while  at  the  same  time  providing  confidence  intervals.  These 
results  will  be  discussed  in  the  follow-on  program,  N000 14-06- 1-0370. 


11 


Figure  9.  Absolute  difference  in  depths  using  dynamic  thresholding  (Left).  This  dynamic  approach 
to  the  optimal  wavelength  threshold  provided  the  best  overall  bathymetry  match  between  the  LIDAR 
and  HSI LUT.  The  percentage  errors  are  given  on  the  Right. 

IMPACTS/APPLICATIONS 

This  research  project  is  focused  on  the  operational  ability  to  estimate  bathymetry,  bottom  type,  target 
detection,  obstacles,  visibility,  and  water  column  IOPs.  This  will  also  include  estimates  of  near  bottom 
scattering  layers  through  the  fusion  of  active  and  passive  optical  remote  sensing  data  streams,  which 
may  be  collected  over  100s- 1000s  of  square  kilometers  per  day.  In  addition  to  the  direct  bathymetry, 
obstacle,  visibility,  and  bottom  type  products  for  NSW,  this  program  will  provide  needed  IOP  data, 
and  its  vertical  structure,  for  the  performance  prediction  of  both  acoustic  and  optical  MCM  detection 
and  identification  systems.  At  the  very  least,  these  data  will  provide  the  information  streams  of 
bathymetry  and  bottom  type,  i.e.  sand,  mud,  rock,  and  clutter,  necessary  to  support  current  Mine 
Warfare  (MIW)  decision  aids.  The  use  of  hyperspectral  sensors  deployed  on  organic  UAV  platforms, 
coupled  with  airborne  (e.g.  LIDAR)  or  in-water  estimates  of  bathymetry  (e.g.  ANAVLD-l(V)l), 
vertically-structure  IOPs  (e.g.  AUVs),  and  bottom  types,  would  allow  for  these  information  streams  to 
be  generated  in  near-real  time  in  the  Littoral  Penetration  Area. 

RELATED  PROJECTS 

The  work  is  part  of  a  larger  project  including  C.  Mobley  of  Sequoia  Scientific,  Inc. 

(N0001404M0108),  and  it  closely  interacts  with  the  project  led  by  C.  Mobley  (N0001404C0218)  and 
PI  Bissett  (N000 140 110201). 
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Accomplishments 

We  have  developed  the  technique  to  rapidly  invert  HyperSpectral  Imagery  (HSI)  data 
into  products  that  include  vertical  structure  in  inherent  optical  properties  (IOPs),  bottom 
type,  and  bathymetry.  These  techniques  include  using  other  data  streams  (i.e.  LIDAR)  to 
constrain  the  HSI  inversion  solution.  In  addition  to  the  direct  bathymetry,  obstacle, 
visibility,  and  bottom  type  products  for  NSW,  this  program  will  provide  needed  IOP  data, 
and  its  vertical  structure,  for  the  performance  prediction  of  both  acoustic  and  optical 
MCM  detection  and  identification  systems.  At  the  very  least,  these  data  will  provide  the 
information  streams  of  bathymetry  and  bottom  type,  i.e.  sand,  mud,  rock,  and  clutter, 
necessary  to  support  current  Mine  Warfare  (MIW)  decision  aids.  The  use  of 
hyperspectral  sensors  deployed  on  organic  UAV  platforms,  coupled  with  airborne  (e.g. 
LIDAR)  or  in-water  estimates  of  bathymetry  (e.g.  AN/WLD-1(V)1),  vertically-structured 
IOPs  (e.g.  AUVs),  and  bottom  types,  would  allow  for  these  information  streams  to  be 
generated  in  near-real  time  in  the  Littoral  Penetration  Area. 


